2026-10-29 20:11:03,285 [ 162739 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2026-10-29 20:11:03,285 [ 162739 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2026-10-29 20:11:03,285 [ 162739 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2026-10-29 20:11:03,285 [ 162739 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_3expjd --privileged --dns-search='.' --memory=30703239168 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1]' 'test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2]' test_executable_user_defined_functions_config_reload/test.py::test test_explain_estimates/test.py::test_explain_estimates test_external_cluster/test.py::test_ddl test_external_cluster/test.py::test_ddl_replicated test_external_http_authenticator/test.py::test_basic_auth_failed test_external_http_authenticator/test.py::test_header_failed test_external_http_authenticator/test.py::test_session_settings_from_auth_response test_external_http_authenticator/test.py::test_user_create_basic_auth_pass test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_dynamic_resize test_filesystem_cache/test.py::test_filesystem_cache_log test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grpc_protocol_ssl/test.py::test_insecure_channel test_grpc_protocol_ssl/test.py::test_secure_channel test_grpc_protocol_ssl/test.py::test_wrong_client_certificate test_hot_reload_storage_policy/test.py::test_hot_reload_policy test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table test_http_and_readonly/test.py::test_http_get_is_readonly test_http_native/test.py::test_http_native_returns_timezone test_inherit_multiple_profiles/test.py::test_combined_profile test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_block_acl/test.py::test_keeper_block_acl test_keeper_compression/test_with_compression.py::test_select test_keeper_disks/test.py::test_logs_with_disks test_keeper_disks/test.py::test_snapshots_with_disks test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout 'test_keeper_zookeeper_converter/test.py::test_acls[False]' 'test_keeper_zookeeper_converter/test.py::test_acls[True]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False]' 'test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True]' 'test_keeper_zookeeper_converter/test.py::test_smoke[False]' 'test_keeper_zookeeper_converter/test.py::test_smoke[True]' test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_iceberg_cluster_function test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree test_named_collections_encrypted/test.py::test_local_storage_encrypted test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge test_non_default_compression/test.py::test_preconfigured_custom_codec test_non_default_compression/test.py::test_preconfigured_default_codec test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec test_non_default_compression/test.py::test_uncompressed_cache_custom_codec test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec test_old_parts_finally_removed/test.py::test_part_finally_removed test_old_versions/test.py::test_client_is_older_than_server test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard test_old_versions/test.py::test_server_is_older_than_client -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_keeper_zookeeper_converter/test.py::test_acls[False] test_non_default_compression/test.py::test_preconfigured_custom_codec test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] test_mask_sensitive_info/test.py::test_backup_table test_grpc_protocol_ssl/test.py::test_insecure_channel test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] test_external_http_authenticator/test.py::test_basic_auth_failed [gw4] [ 1%] PASSED test_external_http_authenticator/test.py::test_basic_auth_failed test_external_http_authenticator/test.py::test_header_failed [gw4] [ 2%] PASSED test_external_http_authenticator/test.py::test_header_failed test_external_http_authenticator/test.py::test_session_settings_from_auth_response [gw6] [ 3%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes [gw8] [ 4%] PASSED test_grpc_protocol_ssl/test.py::test_insecure_channel test_grpc_protocol_ssl/test.py::test_secure_channel [gw6] [ 5%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk [gw8] [ 6%] PASSED test_grpc_protocol_ssl/test.py::test_secure_channel test_grpc_protocol_ssl/test.py::test_wrong_client_certificate [gw2] [ 7%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] [gw2] [ 8%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] [gw6] [ 9%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin [gw2] [ 10%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] [gw1] [ 11%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] [gw5] [ 12%] PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync [gw2] [ 13%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] [gw8] [ 14%] PASSED test_grpc_protocol_ssl/test.py::test_wrong_client_certificate [gw2] [ 15%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] [gw6] [ 16%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin [gw2] [ 17%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] [gw2] [ 18%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] [gw2] [ 19%] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] test_external_cluster/test.py::test_ddl [gw4] [ 20%] PASSED test_external_http_authenticator/test.py::test_session_settings_from_auth_response test_external_http_authenticator/test.py::test_user_create_basic_auth_pass [gw1] [ 21%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] test_filesystem_cache/test.py::test_custom_cached_disk [gw4] [ 22%] PASSED test_external_http_authenticator/test.py::test_user_create_basic_auth_pass test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass [gw5] [ 23%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout [gw4] [ 24%] PASSED test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass test_old_versions/test.py::test_client_is_older_than_server [gw7] [ 25%] PASSED test_non_default_compression/test.py::test_preconfigured_custom_codec test_non_default_compression/test.py::test_preconfigured_default_codec [gw9] [ 26%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_keeper_persistent_log/test.py::test_ephemeral_after_restart [gw5] [ 27%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout [gw5] [ 28%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout [gw9] [ 29%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_keeper_disks/test.py::test_logs_with_disks [gw5] [ 30%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout [gw3] [ 31%] PASSED test_keeper_zookeeper_converter/test.py::test_acls[False] test_keeper_zookeeper_converter/test.py::test_acls[True] [gw9] [ 32%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw6] [ 33%] PASSED test_old_versions/test.py::test_client_is_older_than_server test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard [gw9] [ 34%] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree [gw7] [ 35%] PASSED test_non_default_compression/test.py::test_preconfigured_default_codec test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec [gw6] [ 36%] PASSED test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard test_old_versions/test.py::test_server_is_older_than_client [gw6] [ 37%] PASSED test_old_versions/test.py::test_server_is_older_than_client test_keeper_session/test.py::test_session_close_shutdown [gw2] [ 38%] PASSED test_external_cluster/test.py::test_ddl test_external_cluster/test.py::test_ddl_replicated [gw8] [ 39%] PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart [gw2] [ 40%] PASSED test_external_cluster/test.py::test_ddl_replicated test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges [gw3] [ 41%] PASSED test_keeper_zookeeper_converter/test.py::test_acls[True] test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] [gw8] [ 42%] PASSED test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart [gw7] [ 43%] PASSED test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec test_non_default_compression/test.py::test_uncompressed_cache_custom_codec test_hot_reload_storage_policy/test.py::test_hot_reload_policy [gw7] [ 44%] PASSED test_non_default_compression/test.py::test_uncompressed_cache_custom_codec test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec [gw7] [ 45%] PASSED test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec [gw1] [ 46%] PASSED test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_dynamic_resize test_keeper_internal_secure/test.py::test_secure_raft_works test_http_native/test.py::test_http_native_returns_timezone [gw2] [ 47%] PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table [gw8] [ 48%] PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart [gw6] [ 49%] PASSED test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge test_explain_estimates/test.py::test_explain_estimates [gw1] [ 50%] PASSED test_filesystem_cache/test.py::test_dynamic_resize test_filesystem_cache/test.py::test_filesystem_cache_log [gw3] [ 51%] PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] [gw4] [ 52%] PASSED test_keeper_disks/test.py::test_logs_with_disks test_keeper_disks/test.py::test_snapshots_with_disks [gw1] [ 53%] PASSED test_filesystem_cache/test.py::test_filesystem_cache_log test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges [gw6] [ 54%] PASSED test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts [gw2] [ 55%] PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table [gw7] [ 56%] PASSED test_http_native/test.py::test_http_native_returns_timezone [gw9] [ 57%] PASSED test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout [gw9] [ 58%] PASSED test_keeper_session/test.py::test_session_timeout test_inherit_multiple_profiles/test.py::test_combined_profile [gw8] [ 59%] PASSED test_explain_estimates/test.py::test_explain_estimates test_executable_user_defined_functions_config_reload/test.py::test test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success test_http_and_readonly/test.py::test_http_get_is_readonly [gw8] [ 60%] PASSED test_http_and_readonly/test.py::test_http_get_is_readonly [gw2] [ 61%] PASSED test_inherit_multiple_profiles/test.py::test_combined_profile [gw3] [ 62%] PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] test_keeper_compression/test_with_compression.py::test_select test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw7] [ 63%] PASSED test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success [gw4] [ 64%] PASSED test_keeper_disks/test.py::test_snapshots_with_disks test_keeper_block_acl/test.py::test_keeper_block_acl [gw5] [ 65%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password [gw6] [ 66%] PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts [gw2] [ 67%] PASSED test_keeper_compression/test_with_compression.py::test_select [gw3] [ 68%] PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster test_keeper_four_word_command/test_allow_list.py::test_allow_list [gw8] [ 69%] SKIPPED test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw9] [ 70%] PASSED test_executable_user_defined_functions_config_reload/test.py::test test_keeper_nodes_move/test.py::test_node_move test_named_collections_encrypted/test.py::test_local_storage_encrypted [gw1] [ 71%] PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio [gw1] [ 72%] PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] [gw6] [ 73%] PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr [gw3] [ 74%] PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] test_keeper_zookeeper_converter/test.py::test_smoke[False] [gw4] [ 75%] PASSED test_named_collections_encrypted/test.py::test_local_storage_encrypted test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted [gw3] [ 76%] PASSED test_keeper_zookeeper_converter/test.py::test_smoke[False] test_keeper_zookeeper_converter/test.py::test_smoke[True] [gw1] [ 77%] PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] test_filesystem_cache/test.py::test_system_sync_filesystem_cache [gw7] [ 78%] PASSED test_keeper_block_acl/test.py::test_keeper_block_acl [gw1] [ 79%] PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache [gw9] [ 80%] PASSED test_keeper_nodes_move/test.py::test_node_move test_old_parts_finally_removed/test.py::test_part_finally_removed [gw5] [ 81%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_jbod_ha/test.py::test_jbod_ha [gw3] [ 82%] PASSED test_keeper_zookeeper_converter/test.py::test_smoke[True] [gw0] [ 83%] PASSED test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage [gw2] [ 84%] PASSED test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster [gw0] [ 85%] PASSED test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage test_mask_sensitive_info/test.py::test_backup_to_s3 [gw4] [ 86%] PASSED test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted [gw6] [ 87%] PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr [gw5] [ 88%] PASSED test_jbod_ha/test.py::test_jbod_ha [gw9] [ 89%] PASSED test_old_parts_finally_removed/test.py::test_part_finally_removed Exception in thread Thread-121 (zk_loop): Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner Exception in thread Thread-35 (zk_loop): Exception in thread Thread-6 (zk_loop): Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) self._target(*self._args, **self._kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 512, in zk_loop File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 512, in zk_loop self._target(*self._args, **self._kwargs)if retry(self._connect_loop, retry) is STOP_CONNECTING: File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 512, in zk_loop if retry(self._connect_loop, retry) is STOP_CONNECTING: File "/usr/local/lib/python3.10/dist-packages/kazoo/retry.py", line 126, in __call__ File "/usr/local/lib/python3.10/dist-packages/kazoo/retry.py", line 126, in __call__ return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 552, in _connect_loop status = self._connect_attempt(host, hostip, port, retry) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 602, in _connect_attempt if retry(self._connect_loop, retry) is STOP_CONNECTING:return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 552, in _connect_loop File "/usr/local/lib/python3.10/dist-packages/kazoo/retry.py", line 126, in __call__ response = self._read_socket(read_timeout) return func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 552, in _connect_loop File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 453, in _read_socket status = self._connect_attempt(host, hostip, port, retry) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 602, in _connect_attempt status = self._connect_attempt(host, hostip, port, retry) response = self._read_socket(read_timeout) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 602, in _connect_attempt File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 453, in _read_socket response = self._read_socket(read_timeout) return self._read_response(header, buffer, offset) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 453, in _read_socket File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 376, in _read_response return self._read_response(header, buffer, offset) request, async_object, xid = client._pending.popleft() File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 376, in _read_response IndexError: pop from an empty dequereturn self._read_response(header, buffer, offset) File "/usr/local/lib/python3.10/dist-packages/kazoo/protocol/connection.py", line 376, in _read_response request, async_object, xid = client._pending.popleft() IndexErrorrequest, async_object, xid = client._pending.popleft() IndexError: : pop from an empty dequepop from an empty deque [gw0] [ 90%] PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user [gw0] [ 91%] PASSED test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database [gw0] [ 92%] PASSED test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary [gw0] [ 93%] PASSED test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table [gw0] [ 94%] PASSED test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions [gw0] [ 95%] PASSED test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_iceberg_cluster_function [gw0] [ 96%] PASSED test_mask_sensitive_info/test.py::test_iceberg_cluster_function test_mask_sensitive_info/test.py::test_on_cluster [gw0] [ 97%] PASSED test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl [gw0] [ 98%] PASSED test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl test_mask_sensitive_info/test.py::test_table_function_ways_to_call [gw0] [ 99%] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions [gw0] [100%] PASSED test_mask_sensitive_info/test.py::test_table_functions ----------------- generated report log file: parallel1_0.jsonl ----------------- ============================== slowest durations =============================== 157.70s setup test_mask_sensitive_info/test.py::test_backup_table 112.74s call test_mask_sensitive_info/test.py::test_create_table 68.34s call test_mask_sensitive_info/test.py::test_table_functions 67.59s call test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 65.29s call test_keeper_mntr_pressure/test.py::test_aggressive_mntr 54.10s call test_mask_sensitive_info/test.py::test_backup_to_s3 48.97s call test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 40.70s call test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster 39.08s call test_keeper_block_acl/test.py::test_keeper_block_acl 37.03s call test_old_parts_finally_removed/test.py::test_part_finally_removed 32.90s call test_keeper_nodes_move/test.py::test_node_move 32.78s call test_jbod_ha/test.py::test_jbod_ha 30.32s call test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted 28.63s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 24.97s call test_keeper_disks/test.py::test_logs_with_disks 24.94s call test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 24.56s call test_keeper_disks/test.py::test_snapshots_with_disks 22.70s teardown test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted 22.30s call test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] 22.01s teardown test_keeper_disks/test.py::test_snapshots_with_disks 21.73s call test_executable_user_defined_functions_config_reload/test.py::test 21.29s call test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] 20.48s setup test_keeper_block_acl/test.py::test_keeper_block_acl 20.23s setup test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 19.30s call test_keeper_zookeeper_converter/test.py::test_smoke[True] 18.73s setup test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 18.51s setup test_keeper_memory_soft_limit/test.py::test_soft_limit_create 18.38s call test_keeper_zookeeper_converter/test.py::test_acls[True] 18.16s setup test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster 18.03s setup test_old_parts_finally_removed/test.py::test_part_finally_removed 17.92s setup test_external_cluster/test.py::test_ddl 17.91s call test_mask_sensitive_info/test.py::test_table_function_ways_to_call 17.43s setup test_named_collections_encrypted/test.py::test_local_storage_encrypted 17.39s teardown test_old_parts_finally_removed/test.py::test_part_finally_removed 17.24s call test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] 16.69s setup test_jbod_ha/test.py::test_jbod_ha 16.63s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] 16.58s call test_filesystem_cache/test.py::test_custom_cached_disk 16.56s call test_keeper_internal_secure/test.py::test_secure_raft_works 16.28s setup test_keeper_session/test.py::test_session_close_shutdown 15.77s call test_mask_sensitive_info/test.py::test_iceberg_cluster_function 15.69s setup test_non_default_compression/test.py::test_preconfigured_custom_codec 15.66s setup test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 15.28s call test_keeper_zookeeper_converter/test.py::test_smoke[False] 15.13s setup test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 15.07s setup test_keeper_four_word_command/test_allow_list.py::test_allow_list 15.05s setup test_keeper_internal_secure/test.py::test_secure_raft_works 15.04s setup test_keeper_compression/test_with_compression.py::test_select 14.73s call test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] 14.70s setup test_keeper_mntr_pressure/test.py::test_aggressive_mntr 14.65s call test_non_default_compression/test.py::test_preconfigured_default_codec 14.63s setup test_keeper_zookeeper_converter/test.py::test_acls[False] 14.38s teardown test_mask_sensitive_info/test.py::test_table_functions 13.90s setup test_grpc_protocol_ssl/test.py::test_insecure_channel 13.60s setup test_external_http_authenticator/test.py::test_basic_auth_failed 13.51s setup test_old_versions/test.py::test_client_is_older_than_server 13.44s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 13.41s call test_keeper_session/test.py::test_session_close_shutdown 13.15s setup test_filesystem_cache/test.py::test_custom_cached_disk 13.01s setup test_http_native/test.py::test_http_native_returns_timezone 12.28s teardown test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 12.22s call test_keeper_zookeeper_converter/test.py::test_acls[False] 12.13s setup test_executable_user_defined_functions_config_reload/test.py::test 12.03s setup test_keeper_persistent_log/test.py::test_ephemeral_after_restart 11.58s call test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table 11.03s call test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec 10.96s call test_keeper_persistent_log/test.py::test_state_duplicate_restart 10.53s setup test_keeper_disks/test.py::test_logs_with_disks 10.29s teardown test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster 10.28s setup test_explain_estimates/test.py::test_explain_estimates 10.01s setup test_inherit_multiple_profiles/test.py::test_combined_profile 9.87s setup test_keeper_nodes_move/test.py::test_node_move 8.76s setup test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges 7.48s setup test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success 7.38s call test_mask_sensitive_info/test.py::test_encryption_functions 7.32s call test_filesystem_cache/test.py::test_dynamic_resize 7.05s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 6.62s call test_named_collections_encrypted/test.py::test_local_storage_encrypted 6.38s call test_keeper_persistent_log/test.py::test_ephemeral_after_restart 6.36s teardown test_external_cluster/test.py::test_ddl_replicated 5.88s call test_filesystem_cache/test.py::test_system_sync_filesystem_cache 5.78s teardown test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec 5.69s call test_filesystem_cache/test.py::test_keep_up_size_ratio 5.67s teardown test_old_versions/test.py::test_server_is_older_than_client 5.65s call test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges 5.57s teardown test_filesystem_cache/test.py::test_system_sync_filesystem_cache 5.33s call test_non_default_compression/test.py::test_preconfigured_custom_codec 5.30s call test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success 5.19s teardown test_explain_estimates/test.py::test_explain_estimates 4.97s call test_external_http_authenticator/test.py::test_session_settings_from_auth_response 4.91s call test_mask_sensitive_info/test.py::test_create_alter_user 4.80s teardown test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass 4.75s call test_keeper_persistent_log/test.py::test_state_after_restart 4.60s teardown test_http_and_readonly/test.py::test_http_get_is_readonly 4.59s call test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge 4.41s setup test_http_and_readonly/test.py::test_http_get_is_readonly 4.29s call test_mask_sensitive_info/test.py::test_create_database 4.24s teardown test_grpc_protocol_ssl/test.py::test_wrong_client_certificate 4.21s setup test_hot_reload_storage_policy/test.py::test_hot_reload_policy 4.02s teardown test_keeper_block_acl/test.py::test_keeper_block_acl 3.98s call test_hot_reload_storage_policy/test.py::test_hot_reload_policy 3.90s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 3.58s teardown test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge 3.45s teardown test_http_native/test.py::test_http_native_returns_timezone 3.43s teardown test_inherit_multiple_profiles/test.py::test_combined_profile 3.33s call test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 3.27s call test_external_cluster/test.py::test_ddl 3.06s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 2.83s call test_mask_sensitive_info/test.py::test_create_dictionary 2.75s call test_mask_sensitive_info/test.py::test_on_cluster 2.70s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 2.68s call test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage 2.65s call test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 2.63s call test_filesystem_cache/test.py::test_filesystem_cache_log 2.62s teardown test_keeper_nodes_move/test.py::test_node_move 2.60s teardown test_jbod_ha/test.py::test_jbod_ha 2.57s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 2.57s call test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 2.55s call test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 2.40s teardown test_keeper_memory_soft_limit/test.py::test_soft_limit_create 2.34s teardown test_keeper_mntr_pressure/test.py::test_aggressive_mntr 2.32s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync 2.14s call test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 2.02s call test_grpc_protocol_ssl/test.py::test_insecure_channel 2.01s teardown test_keeper_zookeeper_converter/test.py::test_smoke[True] 2.00s call test_grpc_protocol_ssl/test.py::test_wrong_client_certificate 2.00s call test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 1.95s teardown test_keeper_session/test.py::test_session_timeout 1.90s teardown test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 1.73s call test_old_versions/test.py::test_server_is_older_than_client 1.64s teardown test_keeper_compression/test_with_compression.py::test_select 1.63s teardown test_keeper_four_word_command/test_allow_list.py::test_allow_list 1.61s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 1.57s call test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 1.51s call test_keeper_four_word_command/test_allow_list.py::test_allow_list 1.51s teardown test_executable_user_defined_functions_config_reload/test.py::test 1.50s teardown test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table 1.47s teardown test_filesystem_cache/test.py::test_custom_cached_disk 1.44s call test_explain_estimates/test.py::test_explain_estimates 1.39s call test_non_default_compression/test.py::test_uncompressed_cache_custom_codec 1.39s teardown test_keeper_persistent_log/test.py::test_state_duplicate_restart 1.35s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 1.34s teardown test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success 1.33s call test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl 1.18s call test_inherit_multiple_profiles/test.py::test_combined_profile 1.18s call test_mask_sensitive_info/test.py::test_backup_table 1.10s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 1.07s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 1.01s call test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec 0.95s call test_external_cluster/test.py::test_ddl_replicated 0.91s call test_external_http_authenticator/test.py::test_user_create_basic_auth_pass 0.75s call test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard 0.75s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 0.74s call test_old_versions/test.py::test_client_is_older_than_server 0.53s call test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass 0.45s call test_external_http_authenticator/test.py::test_basic_auth_failed 0.42s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] 0.38s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] 0.34s call test_keeper_session/test.py::test_session_timeout 0.32s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] 0.28s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] 0.27s call test_keeper_compression/test_with_compression.py::test_select 0.27s call test_keeper_memory_soft_limit/test.py::test_soft_limit_create 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] 0.27s call test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] 0.24s call test_grpc_protocol_ssl/test.py::test_secure_channel 0.12s call test_http_and_readonly/test.py::test_http_get_is_readonly 0.10s call test_http_native/test.py::test_http_native_returns_timezone 0.08s call test_external_http_authenticator/test.py::test_header_failed 0.00s teardown test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] 0.00s teardown test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] 0.00s teardown test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] 0.00s teardown test_keeper_persistent_log/test.py::test_ephemeral_after_restart 0.00s teardown test_keeper_persistent_log/test.py::test_state_after_restart 0.00s teardown test_mask_sensitive_info/test.py::test_backup_table 0.00s teardown test_keeper_zookeeper_converter/test.py::test_acls[True] 0.00s teardown test_keeper_disks/test.py::test_logs_with_disks 0.00s setup test_keeper_persistent_log/test.py::test_state_duplicate_restart 0.00s teardown test_keeper_zookeeper_converter/test.py::test_acls[False] 0.00s teardown test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 0.00s setup test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table 0.00s setup test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 0.00s teardown test_keeper_zookeeper_converter/test.py::test_smoke[False] 0.00s setup test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] 0.00s setup test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec 0.00s teardown test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage 0.00s setup test_keeper_zookeeper_converter/test.py::test_acls[True] 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] 0.00s setup test_keeper_zookeeper_converter/test.py::test_smoke[False] 0.00s teardown test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec 0.00s teardown test_external_cluster/test.py::test_ddl 0.00s setup test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams 0.00s setup test_keeper_disks/test.py::test_snapshots_with_disks 0.00s setup test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] 0.00s setup test_mask_sensitive_info/test.py::test_on_cluster 0.00s setup test_mask_sensitive_info/test.py::test_iceberg_cluster_function 0.00s setup test_grpc_protocol_ssl/test.py::test_wrong_client_certificate 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] 0.00s setup test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync 0.00s teardown test_named_collections_encrypted/test.py::test_local_storage_encrypted 0.00s setup test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl 0.00s setup test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s setup test_mask_sensitive_info/test.py::test_encryption_functions 0.00s setup test_external_http_authenticator/test.py::test_user_create_basic_auth_pass 0.00s setup test_filesystem_cache/test.py::test_dynamic_resize 0.00s setup test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_mask_sensitive_info/test.py::test_create_alter_user 0.00s teardown test_filesystem_cache/test.py::test_keep_up_size_ratio 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s setup test_filesystem_cache/test.py::test_keep_up_size_ratio 0.00s teardown test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges 0.00s setup test_mask_sensitive_info/test.py::test_create_database 0.00s setup test_mask_sensitive_info/test.py::test_create_dictionary 0.00s setup test_external_cluster/test.py::test_ddl_replicated 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 0.00s teardown test_external_http_authenticator/test.py::test_session_settings_from_auth_response 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 0.00s setup test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s teardown test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl 0.00s teardown test_mask_sensitive_info/test.py::test_iceberg_cluster_function 0.00s setup test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree 0.00s setup test_mask_sensitive_info/test.py::test_table_functions 0.00s teardown test_filesystem_cache/test.py::test_filesystem_cache_log 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] 0.00s setup test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 0.00s teardown test_mask_sensitive_info/test.py::test_create_database 0.00s teardown test_keeper_internal_secure/test.py::test_secure_raft_works 0.00s setup test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard 0.00s teardown test_mask_sensitive_info/test.py::test_encryption_functions 0.00s teardown test_mask_sensitive_info/test.py::test_on_cluster 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] 0.00s teardown test_mask_sensitive_info/test.py::test_create_dictionary 0.00s teardown test_mask_sensitive_info/test.py::test_create_alter_user 0.00s teardown test_non_default_compression/test.py::test_preconfigured_custom_codec 0.00s setup test_non_default_compression/test.py::test_uncompressed_cache_custom_codec 0.00s setup test_filesystem_cache/test.py::test_filesystem_cache_log 0.00s teardown test_hot_reload_storage_policy/test.py::test_hot_reload_policy 0.00s teardown test_old_versions/test.py::test_client_is_older_than_server 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] 0.00s teardown test_non_default_compression/test.py::test_uncompressed_cache_custom_codec 0.00s teardown test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage 0.00s teardown test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s teardown test_keeper_session/test.py::test_session_close_shutdown 0.00s teardown test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s teardown test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 0.00s teardown test_grpc_protocol_ssl/test.py::test_secure_channel 0.00s setup test_keeper_persistent_log/test.py::test_state_after_restart 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] 0.00s setup test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] 0.00s setup test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] 0.00s setup test_keeper_zookeeper_converter/test.py::test_smoke[True] 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 0.00s teardown test_non_default_compression/test.py::test_preconfigured_default_codec 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] 0.00s teardown test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 0.00s setup test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 0.00s setup test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] 0.00s teardown test_filesystem_cache/test.py::test_dynamic_resize 0.00s setup test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted 0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 0.00s teardown test_grpc_protocol_ssl/test.py::test_insecure_channel 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 0.00s setup test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 0.00s setup test_keeper_session/test.py::test_session_timeout 0.00s setup test_non_default_compression/test.py::test_preconfigured_default_codec 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] 0.00s setup test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass 0.00s setup test_grpc_protocol_ssl/test.py::test_secure_channel 0.00s setup test_old_versions/test.py::test_server_is_older_than_client 0.00s teardown test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] 0.00s teardown test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 0.00s setup test_filesystem_cache/test.py::test_system_sync_filesystem_cache 0.00s setup test_external_http_authenticator/test.py::test_header_failed 0.00s setup test_external_http_authenticator/test.py::test_session_settings_from_auth_response 0.00s teardown test_external_http_authenticator/test.py::test_basic_auth_failed 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 0.00s teardown test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 0.00s teardown test_external_http_authenticator/test.py::test_user_create_basic_auth_pass 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 0.00s teardown test_external_http_authenticator/test.py::test_header_failed =========================== short test summary info ============================ PASSED test_external_http_authenticator/test.py::test_basic_auth_failed PASSED test_external_http_authenticator/test.py::test_header_failed PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used PASSED test_grpc_protocol_ssl/test.py::test_insecure_channel PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes PASSED test_grpc_protocol_ssl/test.py::test_secure_channel PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node1] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[cluster_node2] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node1] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_key[dod_node2] PASSED test_grpc_protocol_ssl/test.py::test_wrong_client_certificate PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node1] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[cluster_node2] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node1] PASSED test_distributed_over_distributed/test.py::TestDistributedOverDistributedSuite::test_select_with_order_by_node[dod_node2] PASSED test_external_http_authenticator/test.py::test_session_settings_from_auth_response PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] PASSED test_external_http_authenticator/test.py::test_user_create_basic_auth_pass PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync PASSED test_external_http_authenticator/test.py::test_user_from_config_basic_auth_pass PASSED test_non_default_compression/test.py::test_preconfigured_custom_codec PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_mutation_max_streams PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_with_where PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout PASSED test_keeper_zookeeper_converter/test.py::test_acls[False] PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_merge_tree_without_where PASSED test_old_versions/test.py::test_client_is_older_than_server PASSED test_mutations_in_partitions_of_merge_tree/test.py::test_trivial_alter_in_partition_replicated_merge_tree PASSED test_non_default_compression/test.py::test_preconfigured_default_codec PASSED test_old_versions/test.py::test_distributed_query_initiator_is_older_than_shard PASSED test_old_versions/test.py::test_server_is_older_than_client PASSED test_external_cluster/test.py::test_ddl PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart PASSED test_external_cluster/test.py::test_ddl_replicated PASSED test_keeper_zookeeper_converter/test.py::test_acls[True] PASSED test_keeper_persistent_log/test.py::test_state_after_restart PASSED test_non_default_compression/test.py::test_preconfigured_deflateqpl_codec PASSED test_non_default_compression/test.py::test_uncompressed_cache_custom_codec PASSED test_non_default_compression/test.py::test_uncompressed_cache_plus_zstd_codec PASSED test_filesystem_cache/test.py::test_custom_cached_disk PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart PASSED test_no_merges_volume_ttl/test.py::test_no_merges_volume_no_regular_merges PASSED test_filesystem_cache/test.py::test_dynamic_resize PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[False] PASSED test_keeper_disks/test.py::test_logs_with_disks PASSED test_filesystem_cache/test.py::test_filesystem_cache_log PASSED test_no_merges_volume_ttl/test.py::test_no_merges_volume_ttl_merge PASSED test_hot_reload_storage_policy/test.py::test_hot_reload_policy_distributed_table PASSED test_http_native/test.py::test_http_native_returns_timezone PASSED test_keeper_session/test.py::test_session_close_shutdown PASSED test_keeper_session/test.py::test_session_timeout PASSED test_explain_estimates/test.py::test_explain_estimates PASSED test_http_and_readonly/test.py::test_http_get_is_readonly PASSED test_inherit_multiple_profiles/test.py::test_combined_profile PASSED test_keeper_zookeeper_converter/test.py::test_multi_and_failed_requests[True] PASSED test_insert_distributed_async_extra_dirs/test.py::test_insert_distributed_async_send_success PASSED test_keeper_disks/test.py::test_snapshots_with_disks PASSED test_keeper_internal_secure/test.py::test_secure_raft_works PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts PASSED test_keeper_compression/test_with_compression.py::test_select PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[False] PASSED test_executable_user_defined_functions_config_reload/test.py::test PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list PASSED test_keeper_zookeeper_converter/test.py::test_simple_crud_requests[True] PASSED test_named_collections_encrypted/test.py::test_local_storage_encrypted PASSED test_keeper_zookeeper_converter/test.py::test_smoke[False] PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] PASSED test_keeper_block_acl/test.py::test_keeper_block_acl PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache PASSED test_keeper_nodes_move/test.py::test_node_move PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password PASSED test_keeper_zookeeper_converter/test.py::test_smoke[True] PASSED test_mask_sensitive_info/test.py::test_backup_table PASSED test_named_collections_if_exists_on_cluster/test.py::test_create_alter_drop_on_cluster PASSED test_mask_sensitive_info/test.py::test_backup_table_AzureBlobStorage PASSED test_named_collections_encrypted/test.py::test_zookeper_storage_encrypted PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr PASSED test_jbod_ha/test.py::test_jbod_ha PASSED test_old_parts_finally_removed/test.py::test_part_finally_removed PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 PASSED test_mask_sensitive_info/test.py::test_create_alter_user PASSED test_mask_sensitive_info/test.py::test_create_database PASSED test_mask_sensitive_info/test.py::test_create_dictionary PASSED test_mask_sensitive_info/test.py::test_create_table PASSED test_mask_sensitive_info/test.py::test_encryption_functions PASSED test_mask_sensitive_info/test.py::test_iceberg_cluster_function PASSED test_mask_sensitive_info/test.py::test_on_cluster PASSED test_mask_sensitive_info/test.py::test_query_masking_rule_with_ddl PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call PASSED test_mask_sensitive_info/test.py::test_table_functions SKIPPED [1] test_keeper_memory_soft_limit/test.py:46: Disabled for sanitizers ================== 99 passed, 1 skipped in 470.35s (0:07:50) ===================